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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE? g/ 19/2001 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36 (a). In no event, however, may a reply be timefy filed after SIX (6) MONTHS from the 
mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 ) |xl Responsive to communication(s) filed on 8, 19/2002 



2a) □ This action is FINAL. 2b) K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 ; 453 O.G. 213. 

Disposition of Claims 

4) (xl Claim(s) 1-48 is/are pending in the application. 



4a) Of the above, claim(s) 
5)D Claim(s) 



6) B Claim(s) 1-5, 10-29, 31-35, and 39-48 



7) 1x1 Claim(s) 6-9, 30 and 36-38, 

8) D Claims 



is/are withdrawn from consideration. 

is/are allowed. 

is/are rejected. 

is/are objected to. 



are subject to restriction and/or election requirement. 



Application Papers 

9)D The specification is objected to by the Examiner. 

10)1x1 The drawing(s) filed on 1 1/ 24/ 2002 is/are a)K accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
1 1 )□ The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner, 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) D Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some* c)D None of: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 



3. □ Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
*See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 1 19(e). 
a)D The translation of the foreign language provisional application has been received. 

15) D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. §§120 and/or 121 . 
Attachments} 

1 ) 53 Notice of References Cited iPTO-892) 4) □ Interview Summary (PT0-41 3 J Paper No(s>. 

2) O Notice of D raft spa rson's Patent Drawing Review (PT 0-948) 5) Q Notice of Informal Patent Application (PTO-1 521 

3) (x| Information Disclosure Statement(s) {PTO-1 449) Paper No(s). 9, 10 6) Q Other: 
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RESPONSE TO AMENDMENT 



1. 



Applicants, amendment filed, 8/ 19/ 2002, has been entered and made of record. 



2. Applicants' arguments with regards to Claims 1-48, have been fully considered but they 
are moot in view of the new grounds of rejection. 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



4. Claims 1-5, 10-29 and 31-33, are rejected under 35 U.S.C. 103(a) as being unpatentable 



Regarding claim 1, Maki et al disclosse a system, comprising a computer configured to 
determine a position and shape of an object of interest from video images and characterize 
activity of said object of interest based on analysis of changes in said position and said shape 
over time, (see column 15, lines 49-57, refer to detecting information about position, shape and 
posture of object, also column 32, lines 56-67, refer to target object and configured to determine 



DETAILED ACTION 



Claim Rejections - 35 U.S.C § 103 



over Maki et al (U.S.6,072,903) in view of Hsieh (U.S.5,546,439). 
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pixels corresponding, and position and posture of target). 

However Maki et al does not explicitly state " computer configured " . On the other 
hand Hsieh, teaches (column 6, lines 58-67, the "computer configured to identify, for an object of 
interest"). 

Therefore it would have been obvious to a person of ordinary skill in the art at time the 
invention was made, to modify Maki et al invention according to the teachings of hsieh because 
it is processing part of computer or information detecting unit that enable to identify object of 
interest which fully satisfies the requirements of claim. 

Regarding claim 2, Maki et al discloses the system of claim 1, further comprising: a video 
camera coupled to said computer for providing said video images, (see column 23, line 64 throw 
column 24, line 7, tracking of motion picture, by use of television camera). 

Regarding claim 3, Maki et al disclose the system of claim 2, further comprising: a video 
digitization unit couple to said video camera and said computer for converting said video images 
provided by said video camera from analog to digital format, (see above claims and column 8, 
lines 46-51, refer to using a digital filter). 

Regarding claim 4, Maki et al discloses the system of claim 3, further comprising: a 
storage/retrieval unit coupled to said video digitization unit, said video camera, and said 
computer, for storing said video images and standard object video images, (see column 25, lines 
32-37, refer to storage section). 

Regarding claim 5, Maki et al discloses the system of claim 1, wherein said computer 
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includes an object identification and segregation module receiving said video images, (see 
column 29, lines 23-28, refer to receiving three-dimensional position information). 
Regarding claim 13, Maki et al disclose the system of claim 1, wherein said object is a mouse, 
(see column 2, lines 20-26 refer to three dimensional mouse). 

Regarding claim 16, Maki et al discloses a method of determining and characterizing 
activity of an object using computer processing and identifying and classifying the changes, (see 
column 3, lines 15-22, refer to changes of image in different time, and also column 27, lines 20- 
31, refer to comparison and synthesizing the images). 

Regarding claim 19, Maki et al discloses the method of claim 18, wherein said step of 
generating a background image includes the step of determining variation in intensity of pixels 
within said individual frames to identify a region where said foreground object is located, (see 
column 19, linse 44-52, corresponding to pixel and intensity of the light). 

Regarding claim 26, Maki et al discloses the method of claim 24, wherein said step of 
identifying and classifying changes to said foreground object uses contour-based shape 
information selected from the group consisting of b-spline representation, convex hull 
representation, and corner point, (see column 9, lines 14-23, refer to connected feature points, 
such as outer corner of the eye ). 

Regarding claim 27, Maki et al discloses the method of claim 24, wherein said step of 
identifying and classifying changes to said foreground object includes identifying a set of model 
postures and their description information, said set of model postures including horizontal 





♦ • 
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posture, vertical posture, eating posture, or sleeping posture, (see column 25, lines 6-11, refer to 
posture information). 

With regard to claims 10-15, 17-18, 20-25, 28-29 and 31-33, the arguments analogous to 
those presented for claims above are applicable. 

5. Claims 34-35 and 39-48, are rejected under 35 U.S.C. 103(a) as being unpatentable over 
as applied to claim above, and further in view of Smith et al (U.S. 5, 870,138). 

Regarding claim 34, Maki et al discloses the method of claim 33, wherein said temporal 
analysis is a time-series analysis such as Hidden Markov Model (HMMs), (see above claims). 

However Maki et al and Hsieh does not explicitly state " Hidden Markov Model " . On 
the other hand Smith et al teaches (column 17, lines 41-43, the device can be implemented as a 
Hidden Markov Model and has two phases of operation, namely training and recall). 

Therefore it would have been obvious to a person of ordinary skill in the art at time the 
invention was made, to modify Maki et al and Hsieh invention according to the teachings of 
Smith et al because it is device to map the input data (images) from the camera to outputs which 
represents the probability of the input images belonging to a specified set of expressions, and can 
easily be implements in an images device such as video camera. 

With regard to claims 35 and 39-48, the arguments analogous to those presented for 
claims above are applicable. 



Other prior art cited 
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6. U.S. patent 5,596,994 to Bro is cited for automated and interactive behavioral and 
medical guidance. 

Allowable Subject Matter 

7. Claims 6-9, 30 and 36-38, are objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 

Contact Information 

8. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Seyed Azarian whose telephone number is (703) 306-5907. 

The examiner can normally be reached on Monday through Thursday 6:00 a.m. to 7:30 p.m. If 

attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 

Bhavesh Mehta, can be reached at (703)308-5246. 

Any response to this action should be mailed to: 

Assistant Commissioner for Patents 
Washington, D.C. 20231 
or faxed to: 

(703) 872-9319, ("draft" or "informal"communications should be clearly labeled 
to expedite delivery to examiner) 



Hand delivered responses should be brought to Crystal Park n, 2121 Crystal Drive, 



Serial Number: 09/7 1 8,374 Page 7 

Art Unit: 2625 

Arlington, VA., Sixth Floor (Receptionist). 



Any inquiry of a general nature or relating to the status of this application should be directed to 
the T.C. customer service office whose telephone number is (703) 306-0377. 



Seyed Azarian 




Patent Examiner 
Group Art Unit 2625 
October. 9, 2002 



